What is a BCA?
Information Sheet
Introduction
A NETC BCA is defined by NETCINST 1510.3. It provides a structured methodology to facilitate a decision making process. It provides a process for identifying critical business opportunities and facilitating the gathering and analyzing information, developed requirements necessary for address key training opportunities.
References
NETC N721B Costing Tool
Data and approach from NETPDTC IDIQ Contract
Information
The key information topics provided by each BCA:
Executive Summary
Project Background
Analysis of Alternatives
Resource Cost
Training Content Cost
Number of Training Days (Individual Account (IA))
Technical Training Equipment (TTE) or other Training Equipment (to include Life Cycle Cost)
Risk Assessment
Cost/Benefit Analysis
Recommendation
Implementation Strategy
After this data is created, the project manager working with the team (or COC or worse case by themselves) should perform an Analysis of Alternatives (AoA) to determine different approaches which achieve the "Return on Expectations", not Return on Investment (ROI). Flexibility is the critical attribute in this review along with an understanding of the training requirement. The FEA should outline the training requirement. From the FEA, many possible training solutions become available, different delivery methods, equipment options, etc..... The project manager must take all of these things into account. In some cases, it maybe required to break the cost estimate down from the whole course to options within specific training modules or lessons. In some cases a very complex solution (doesn't have to be complex, might be big, significant, etc...) may have a cost estimate. Cost estimates are a very powerful tool in program management of efforts. They allow a program manager to plan a workforce, estimate time to develop that solution, to map out key events that must be performed to support that requirement, etc..... So, it should be used to support the plan or update the plan depending on AoA.
The overall BCA, which should include various AoA. Recommended alternative will be sent to the Requirements Sponsor, so they can work with the Resource Sponsor (OPNAV in most cases) to secure the resources required to implement the training program designed by the E2E process. The Learning Center should include the FEA with the BCA since it will provide or support the various alternatives. Once a specific alternative has been selected by the Requirements Sponsor, the Training Project Plan (TPP) can be created and submitted.
A note on Alternatives?
NETC says you should have three minimum.
AoA 1 should be the recommended approach
AoA 2 should be an approach that still meets the instructional need
AoA 3 represents the current state
Others as appropriate
The three AoA's are NOT as simple as 1- ILT, 2- IMI and 3-Blended Learning
The E2E process (specifically the FEA if done correctly) provides large amounts of flexibility in determining the AoA's available to the Requirements Sponsor. An example is below:
The TLO is Operate the Widget a related TLO is Perform Maintenance on the Widget. Since the expected lack of TTE will be an issue and cause course bottlenecks, the following AOA's are provided:
AoA1 would be to teach the lesson at a KPL2, use PC simulation (high fidelity) to allow the students more practice before going to lab and allowing each student to operate and maintain the widget using a round robin approach to control bottlenecks. Students impacted by bottlenecks will be performing other self-paced labs on related task like 3M or maintenance of things related to the Widget. These self-paced lab will require an additional instructor to maintain an acceptable level of safety during the lab. (This approach offsets the lack of TTE by adding instructors that can be teaching students on other pieces of equipment or simulation at the same time to constantly expose the student to more problems and practical exercises that are similar to the ones they will perform on the job)
AoA2 would be to increase the number of training days to allow the labs to be completed properly. If the increase of training days cannot be fully meet, recommend a reduction of KPL1 Knowledge - Lecture in the classroom with a transition to self-paced or self-study (this does not mean CBT, it may) (Please note, in your AoA's you try and present methods that meet your Learning Objectives, if it says Operate and Perform maintenance, the student MUST operate and maintain or the action verb of the TLO needs to be changed. The developer MUST ensure the alignment between the work, the learning objective and the assessment strategy.)
AoA3 would make the students take the knowledge parts of the class using SAKAI or NeL and the students after passing a test will be allowed to go to lab to practice and then be assessed.
AoA4 not resources are available, the requirements sponsor decides a different approach will be created. (on this one, it is important to understand that the Fleet Requirement belongs to the Requirements Sponsor and not the Learning Site. Now the reason we performed the E2E process needs assessment and needs analysis documented by the three 29612B DID's (17B, 18B and 19B) is some no cost improvements (see page on suggestions) may have been identified or the improvement of other resources like Rate Training Manuals (RTM), Technical Manuals, Electronic Support Tools, etc...)
Methods to conduct a Content Development Cost Estimate
NOTE: Below is an example of the tool that we use in NETC N72, it is not mandatory, it is just a tool. The method, following a consistent process and hitting the Government Cost Estimate with the Contract Award's actual cost is the important part. Coming up with a cost estimate that doesn't accurately reflects actual cost, has limited or no value.
Example: FEA states the training requirement is "Troubleshoot the widget"
The technical manual outlines about 50 task associated to this requirement (50 task in a technical manual is not that same as a JDTA task)
The JDTA states that a KPL2 (Application / Analysis) and SPL2 (Precision) level is the required proficiency level for Knowledge and skills.
The TSR and FEA states that "Troubleshoot the Widget" should be a blended learning solution, using IMI level III (Levels of Interactivity) with practice occuring on a PC SIM (6 problems are required for the student to reach the desired proficiency level) and assessed on the available TTE. PC SIM training time is estimated at 20 minutes per problem and requires OSCOPE, Multimeter, common hand-tools and electrical safety factors to be addressed. Instructional time is 1 hours, final assessment is 30 min's per student.
Steps to turn above example into a cost estimate:
1) Make sure you understand the data that you are cost estimating. If you don't ask an SME to explain it or walk you thru the process. The more you understand, the better the estimate will be.
2) Break down the available data into chunks that you can use to create a cost estimate, using spreadsheet below:
A medium complex JDTA, based on 50 technical manual task, on average, takes 1 person 350 hours to complete the whole process.
Creating 1 hour of blended learning using AIM LO Module at a KPL2, on average, takes 1 person 50 hours to complete the whole process.
Creating 2 hours (6 - 20min practice scenario) Level III IMI, supporting a complex PC-SIM, on average, takes 1 person 600 hours (300 x 2 hours) to complete the whole process. Since we are talking about practice and assessments problems, remediation and back-up test also need to be factored in. At a minimum a factor of 50% pool of additional problems (3 more practice and 2 final exam) should be created, or almost an additional 2 instructional hours. Raises the hours to 1,200 hours.
To support the 6 practice and 1 final assessments, job-sheets and an Authentic Assessment / Rubric will need to be created. On average, takes 1 person 350 hours (7 problems at 50 hours to develop per problem) to complete the whole process. Since we are talking about practice and assessments problems, remediation and back-up test also need to be factored in. At a minimum a factor of 50% pool of additional problems (3 more practice and 1 more final exam) should be created. Raises the hours to 500 hours.
3) Review per hour development cost or average government / Sailor or Contractor burden rate average. Contact NETC N72 (757-322-9717) for the current average being used, for the purposes of the example we will use $50 per hour. To create the job-sheets and an Authentic Assessment / Rubric will need to be created and the cost estimate is $25,000.
Detailed Cost Estimating Tool based on Specific Products or Media Development
4) Using data captured above in the example and using the above spreadsheet, along with the spreadsheet below additional factors can also be factored into the overall cost estimate. The below spreadsheet also supports FEA data not as well detailed as above. In the above example, we knew the number of problems, how long they would be, etc...
In this example, using the below spreadsheet, the TSR/FEA states that "Troubleshoot Widget" and that the technical manual shows that as 50 task.
5) Using the below spreadsheet, content types, storyboards, estimate the number of 3D Models or photo shoot will be developed or required. It can still benifit from the spreadsheet above, but allows additional factors to be taken into account. This spreadsheet also introduces risk, if this is the first time the vendor is performing a function, a risk factor cost may also be added to the project.
6) If this is a maintenance effort on existing IMI, you can simply just count the number of screens associated to the categories listed below to determine size and scope of the effort.
Medium Detail Cost Estimating Tool - Supports Procedure and IMI Maintenance Efforts
7) The final spreadsheet can be used stand-alone or with the other ones listed above. If all three spreadsheets are used, the detail and accuracy of the cost estimate should improve. Since that's seldom practical or to support a Rough Order of Magnitude (ROM) on something that has limited data the below spreadsheet is used.
In the example list at the top of this section 1 hour of blended learning and 4 hours of practice and assessment problems, simple take the development ratio for each 1 hour blended learning at 50 development hours and 300 development hours (4 x 300 = 1200) for the problem development times $50 per hour = Project Cost Estimate ($62,500)
8) One benefit of this spreadsheet listed below is it takes into labor categories and converts that to man-hours that can be compared against vendor proposals for executing the work. It also provides cost data for risk factor, vendor contract fee and travel cost.
High Level Cost Estimating Tool - Provides a Cost Estimate based on Training Hours or Hours Projected for Development (Least Accurate but Quick Approach)
Information Sheet
Introduction
A NETC BCA is defined by NETCINST 1510.3. It provides a structured methodology to facilitate a decision making process. It provides a process for identifying critical business opportunities and facilitating the gathering and analyzing information, developed requirements necessary for address key training opportunities.
References
Information
The key information topics provided by each BCA:
- Executive Summary
- Project Background
- Analysis of Alternatives
- Resource Cost
- Training Content Cost
- Number of Training Days (Individual Account (IA))
- Technical Training Equipment (TTE) or other Training Equipment (to include Life Cycle Cost)
- Risk Assessment
- Cost/Benefit Analysis
- Recommendation
- Implementation Strategy
After this data is created, the project manager working with the team (or COC or worse case by themselves) should perform an Analysis of Alternatives (AoA) to determine different approaches which achieve the "Return on Expectations", not Return on Investment (ROI). Flexibility is the critical attribute in this review along with an understanding of the training requirement. The FEA should outline the training requirement. From the FEA, many possible training solutions become available, different delivery methods, equipment options, etc..... The project manager must take all of these things into account. In some cases, it maybe required to break the cost estimate down from the whole course to options within specific training modules or lessons. In some cases a very complex solution (doesn't have to be complex, might be big, significant, etc...) may have a cost estimate. Cost estimates are a very powerful tool in program management of efforts. They allow a program manager to plan a workforce, estimate time to develop that solution, to map out key events that must be performed to support that requirement, etc..... So, it should be used to support the plan or update the plan depending on AoA.The overall BCA, which should include various AoA. Recommended alternative will be sent to the Requirements Sponsor, so they can work with the Resource Sponsor (OPNAV in most cases) to secure the resources required to implement the training program designed by the E2E process. The Learning Center should include the FEA with the BCA since it will provide or support the various alternatives. Once a specific alternative has been selected by the Requirements Sponsor, the Training Project Plan (TPP) can be created and submitted.
A note on Alternatives?
Methods to conduct a Content Development Cost Estimate
NOTE: Below is an example of the tool that we use in NETC N72, it is not mandatory, it is just a tool. The method, following a consistent process and hitting the Government Cost Estimate with the Contract Award's actual cost is the important part. Coming up with a cost estimate that doesn't accurately reflects actual cost, has limited or no value.
Example: FEA states the training requirement is "Troubleshoot the widget"
Steps to turn above example into a cost estimate:
1) Make sure you understand the data that you are cost estimating. If you don't ask an SME to explain it or walk you thru the process. The more you understand, the better the estimate will be.
2) Break down the available data into chunks that you can use to create a cost estimate, using spreadsheet below:
- A medium complex JDTA, based on 50 technical manual task, on average, takes 1 person 350 hours to complete the whole process.
- Creating 1 hour of blended learning using AIM LO Module at a KPL2, on average, takes 1 person 50 hours to complete the whole process.
- Creating 2 hours (6 - 20min practice scenario) Level III IMI, supporting a complex PC-SIM, on average, takes 1 person 600 hours (300 x 2 hours) to complete the whole process. Since we are talking about practice and assessments problems, remediation and back-up test also need to be factored in. At a minimum a factor of 50% pool of additional problems (3 more practice and 2 final exam) should be created, or almost an additional 2 instructional hours. Raises the hours to 1,200 hours.
- To support the 6 practice and 1 final assessments, job-sheets and an Authentic Assessment / Rubric will need to be created. On average, takes 1 person 350 hours (7 problems at 50 hours to develop per problem) to complete the whole process. Since we are talking about practice and assessments problems, remediation and back-up test also need to be factored in. At a minimum a factor of 50% pool of additional problems (3 more practice and 1 more final exam) should be created. Raises the hours to 500 hours.
3) Review per hour development cost or average government / Sailor or Contractor burden rate average. Contact NETC N72 (757-322-9717) for the current average being used, for the purposes of the example we will use $50 per hour. To create the job-sheets and an Authentic Assessment / Rubric will need to be created and the cost estimate is $25,000.4) Using data captured above in the example and using the above spreadsheet, along with the spreadsheet below additional factors can also be factored into the overall cost estimate. The below spreadsheet also supports FEA data not as well detailed as above. In the above example, we knew the number of problems, how long they would be, etc...
In this example, using the below spreadsheet, the TSR/FEA states that "Troubleshoot Widget" and that the technical manual shows that as 50 task.
5) Using the below spreadsheet, content types, storyboards, estimate the number of 3D Models or photo shoot will be developed or required. It can still benifit from the spreadsheet above, but allows additional factors to be taken into account. This spreadsheet also introduces risk, if this is the first time the vendor is performing a function, a risk factor cost may also be added to the project.
6) If this is a maintenance effort on existing IMI, you can simply just count the number of screens associated to the categories listed below to determine size and scope of the effort.
In the example list at the top of this section 1 hour of blended learning and 4 hours of practice and assessment problems, simple take the development ratio for each 1 hour blended learning at 50 development hours and 300 development hours (4 x 300 = 1200) for the problem development times $50 per hour = Project Cost Estimate ($62,500)
8) One benefit of this spreadsheet listed below is it takes into labor categories and converts that to man-hours that can be compared against vendor proposals for executing the work. It also provides cost data for risk factor, vendor contract fee and travel cost.